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ABSTRACT 

As institutions of higher learning, universities must devote significant resources in developing in¬ 
tellectual capital in the use of educational technology to sustain their viability. To better under¬ 
stand satisfaction in technology used in classrooms, a psychometric instrument was developed to 
identify and measure the specific factors of satisfaction with the technology in a business school 
setting. Additionally, this instrument is employed on a sample of business students as a means of 
reporting satisfaction levels with educational technology. We show that students’ satisfaction with 
educational technology is related to four main factors: Proficiency, assessment, performance, and 
preference toward Web-courses. 

1 Authors thank Jim Dodd, Doug Hillman, Brad Meyer, Tom Root, and Troy Strader for their 
helpful comments and suggestions. Support for this research was provided by Drake University Cen¬ 
ter for Digital Technology and Learning (CDTL). All remaining errors are our own. 

INTRODUCTION podcasts to disseminate course information. As 

technology has become much more complicated, 
In the not so distant past, students would come p } las a l so become a more accepted and expected 
to class on the first day of school and sometimes form of course delivery in institutions of higher 
ask if the professor had a copy of syllabus to hand learning 
out. Technology seemed very simple in those days. 

Today, students come to class and sometimes ask proliferation of technology in all aspects of 

if the syllabus and course material will be avail- student life has affected institutions of higher 
able on Blackboard, CourseSmart, WebCT, learning in general, and business schools more 
Homework Manager or any other Web-based specifically. Most students and faculty are get- 
course management system. They also want to dng ver y comfortable with various technological 
know if you will be using Facebook, Twitter, and applications both inside and outside of the class- 
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room. As universities and faculty adopt more 
and more technological applications as tools for 
teaching course material, it is assumed that stu¬ 
dents’ learning environment is enhanced. There 
are, however, some basic questions that should 
be answered in order for instructors to better un¬ 
derstand the use of technology in supporting the 
teaching and learning functions. Some of those 
questions are: 

• What are students’ preferences in the use of 
technology? 

• How do students react to technology? 

• How satisfied are students with the utiliza¬ 
tion oftechnology? 

Those questions led a group of professors at a 
small Midwestern university to investigate the 
use of educational technology in a business col¬ 
lege setting. 

There are various reasons why it is becoming 
more and more imperative to gain a greater un¬ 
derstanding of the modern student experience in 
relation to technology. Technologies can enrich 
the experiences of students in an educational 
community. One of the missions of a viable uni¬ 
versity is preparing students for their future lives 
and careers (Blackburn and Tawrence, 1986). 
Universities’ intellectual capital in the use of 
technology is critical to competing for students 
and in sustaining viability as institutions of high¬ 
er learning. 

The general trend at the university level is that 
technology is assumed to be a natural part of 
the environment for students (Oblinger, 2003). 
This has become the information-age generation 
of students. This comfort with technology often 
leads to the perception that the use of technology 
in classes, at an adequate level, enhances student 
satisfaction. But such perceptions may or may not 
be accurate. Colleges and universities are coming 
to understand that meeting student expectations 
as they relate to technology is essential to provid¬ 
ing a satisfactory student experience. 

Beyond higher education in general, understand¬ 
ing technology in the context of business schools 
is perhaps even more important. Business is an 
applied discipline that is also multidisciplinary, 
thereby requiring a certain level of technical ex¬ 
pertise (Jaju, Kwah and Zinkhan, 2002). Quan¬ 


titative and qualitative skills are needed in the 
discipline. Practical and experience-based skills 
are also emphasized. Various applications of 
technology are often employed in the teaching 
of such skills. It is therefore important that pro¬ 
fessors understand student satisfaction with the 
technology they are asked to use. In spite of the 
importance of understanding student experience 
with technology, there appears to be a relative 
lack of research on the nature of student satisfac¬ 
tion with such. 

To examine the relationship between technol¬ 
ogy and student satisfaction, we first need a clear 
definition of technology. According to the As¬ 
sociation for Educational Communications and 
Technology (AECT), educational technology is 
defined as “the study and ethical practice of facil¬ 
itating learning and improving performance by 
creating, using and managing appropriate tech¬ 
nological processes and resources” (www.aect. 
org/about/div_.asp?DivisionalD=18). Hence, in 
our study, we consider educational technology to 
encompass a variety of instructional tools such 
as computers, software titles, multimedia equip¬ 
ment, Internet applications, mobile devices and 
any other electronic instruments employed by an 
instructor to facilitate student learning. 

The purpose of this study is to identify and es¬ 
tablish the specific facets of technology satisfac¬ 
tion. In this study, a psychometric instrument 
to measure the perceived factors that comprise 
technology satisfaction in a business school set¬ 
ting is developed. Additionally, this instrument 
is employed on a sample of business students as a 
means of reporting satisfaction levels with tech¬ 
nology. 

LITERATURE REVIEW 

Satisfaction as a construct has been used in the 
technology field. It is often associated with the 
acceptance or rejection of technology. A review 
of the technology studies quickly reveals that, 
when satisfaction is used, there appears to be no 
consistent definition of the construct in the con¬ 
text of technology. It is most often used as an out¬ 
come factor that seems to have some importance 
(Graham and Scarborough, 2001; Thurmond, 
Wambach, Connors, and Frey, 2002; Maki and 
Maki, 2003). 
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Studies on satisfaction in technology rely most¬ 
ly on self-report surveys by students. Varmosi, 
Pierce, and Slotkin (2004) surveyed students to 
determine satisfaction with different learning 
delivery modes. Among other things, students 
were asked to report on their effectiveness in us¬ 
ing technology as well as their level of comfort 
in using technology. In his study on students’ 
satisfaction with Internet-based MPA courses, 
Arbaugh (2000) used a survey instrument that 
required students to report on their perceived 
level of satisfaction in usage of the Internet as a 
delivery mode. 

There appears to be some research on the nature 
of student satisfaction with technology in lim¬ 
ited situations. There is, however, a plethora of 
work on satisfaction as a construct in other busi¬ 
ness contexts. Various studies have indicated that 
employees and students share similarities (Cot¬ 
ton, Dollard, and dejonge, 2002; Toff, Fleet and 
Timutimu-Thorpe, 1996). For this reason, work 
on job satisfaction is used as a foundation for 
exploring the facets of student satisfaction with 
technology. 

Satisfaction as a construct has a long history in 
business. It is considered to be an attitude and 
is usually expressed as a continuum from high 
satisfaction (positive attitude) to low satisfaction 
(negative attitude); (Hitt, Miller, and Colella, 

2006) . The type of satisfaction most studied in 
a business context is job satisfaction. Job satisfac¬ 
tion in its most simple form reflects the extent 
to which a person likes their job. Job satisfaction 
involves an effective response toward the various 
aspect or facets of the job (Kreitner and Kinicki, 

2007) . This indicates that job satisfaction is not 
a single concept but rather a construct comprised 
of multiple factors. 

Researchers at Cornell University found that job 
satisfaction contains the dimensions of work, 
pay, promotions, co-workers and supervision 
(Smith, Kendall, and Hulin, 1969). Other re¬ 
searchers have concluded that there are twenty 
different dimensions underlying job satisfaction 
(Weiss, Dawis, England, and Tofquist, 1967). 
Job satisfaction has been one of the most re¬ 
searched attitudes with more than 12,000 stud¬ 
ies published by the 1990’s (Kinicki, McKee-Ry- 
an, Schriesheim, and Carson, 2002). 
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There are two initial questions concerning sat¬ 
isfaction as it relates to technology that need to 
be addressed. First, what are the facets or aspects 
that make up technology satisfaction? And sec¬ 
ond, what levels of technology satisfaction do 
business students possess? Valid support for these 
fundamental questions appears to be sparse. Ex¬ 
isting research on students focuses on student 
satisfaction with the university (Astin 1993) or 
academic performance and college characteris¬ 
tics (Astin, 1993; Kuh and Hu, 1999, 2001; Hu 
and Kuh, 2003). Because of the noted similarities 
between students and employees, it follows that 
student satisfaction evaluations for their univer¬ 
sity or college would be similar in many respects 
to employee satisfaction evaluations for their em¬ 
ployers. Furthermore, like job satisfaction, tech¬ 
nology satisfaction seems to have several facets 
that are reflected in student evaluations of the 
use of technology in the university experience. 

So, what are the facets of technology satisfaction 
that should be pursued? Most of the recent re¬ 
search has focused on distance learning as repre¬ 
senting the use of technology in teaching. These 
studies point to many features that may predict 
student satisfaction with distance learning class¬ 
es. These predictor variables include such things 
as: 

• Student-teacher interaction (Bates, 1984; 
Feldman, 1989) 

• Student-materials interactions (Perraton, 
1991) 

• Access to technology (Bates, 1995; Cybela, 
1996) 

• Perceived quality (Perraton, 1991; Bates, 
1984) 

• Prior experience (Gabrielle, 2001) 

• Technological levels (Gehlauf, Shatz and 
Frye, 1991). 

Most research that explores the construct of sat¬ 
isfaction in the context of technology is some¬ 
what narrow in context, focusing on student 
satisfaction in Web-based instruction. In this 
context, satisfaction is generally treated as a 
simple construct assessed by as few as one scale 
item and as many as 21 scale items. For example, 
Vasmosi, Pierce, and Slotkin (2004) measure sat- 
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isfaction for Internet courses with a single-item 
scale. Eom, Wen, and Ashill (2006) combine 
three items measuring the quality of the online 
course relative to face-to-face courses, intent to 
recommend, and intent to take online courses 
in the future into one satisfaction measure. Ar- 
baugh (2000b) measured student satisfaction 
with Internet-based MBA courses via a 12-item 
scale designed around satisfaction with the Inter¬ 
net course, perception of quality, and likelihood 
of taking future Internet courses. (See Table 1 for 
a summary of satisfaction measures from various 
articles.) 

Based on the definition of technology that we 
provide, there is a need for a broader measure 
of satisfaction in order to assess students over¬ 
all capabilities and comfort level with various 
types of technology applications. Additionally, 
the above-noted studies assess the satisfaction 
of students who self-selected into those courses 
thereby limiting the researcher’s ability to gen¬ 
eralize the findings to student satisfaction levels 
with technology in general. This indicates a gap 
in the research that identifies exactly what satis¬ 
fies students about the use of technology in the 
classroom whether it is Web-based or traditional. 


The level of satisfaction then becomes critical 
as it has the potential to impact the effects that 
technology has on students. The use of technol¬ 
ogy in the classroom today is often expected as 
part of instruction. The research that has been 
conducted on technology as an instructional tool 
is headed in the right direction but needs to be 
developed in the area of student satisfaction with 
technology. This study responds to this gap in the 
extant research. The following section describes 
the development of a psychometric scale designed 
to measure multiple facets of student satisfaction 
with technology for Web-based courses as well as 
traditional courses. 

METHODOLOGY 

Because of the scarcity of research in the specific 
area of college student satisfaction toward tech¬ 
nology, a metric is developed to accomplish the 
purposes of this research. After having estab¬ 
lished a theoretical basis for different facets of 
technology satisfaction, the following sections 
describe the process followed to empirically es¬ 
tablish such facets as well as to develop instru¬ 
ments to measure such. Our methods are based 


Table 1 


Previous research establishing a relationship between technology and satisfaction 

Past Studies 

Technology Assessed 

Satisfaction Measure 

Annetta andMinogue (2004) 

Interactive Television 

Single-item scale 

Arbaugh (2006) 

Internet Course 

Twelve-item scale 

Beckert, Fauth, and Olsen (2009) 

Clicker 

Twenty one-item scale 

Ebenezer, Lugo, Beirnacka and Puvirajah (2003) 

Electronic Discussion 

Boards 

Reflective dialogues 

Eom, Wen and Ashill (2006) 

Online Course 

Three-item scale 

Feldmann, Wess, andMoothart (2008) 

Laptop Service 

Single-item scale 

Frederickson, Reed, and Clifford (2005) 

Web Sessions 

Five-item scale 

Frey, Alman, Barron and Steffens (2004) 

Online Program 

Learner comments 

Hazari, North, and More (2009) 

Wiki 

Twenty-item scale 

Piccoli, Ahmad, and Ives (2001) 

Virtual Learning 
Environments 

Three-item scale 

Shneiderman, Borkowski, Alavi and Norman (1998) 

Electronic Classroom 

Six-item scale 

Vasmosi, Pierce, and Slotkin (2004) 

Internet Course 

Single-item scale 

Warnock, Boykin, and Tung (2008) 

Smart Board 

Four-item scale 
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on traditional scale development procedures 
(Churchill, 1979; Gerbing and Anderson, 1988). 

Phase 1: Scale Development 

Item Generation. The exploratory stage of our 
research sought to generate a pool of items 
that would characterize the nature of satisfac¬ 
tion toward technology. This was accomplished 
through a review of relevant literature and by 
adapting such to the purposes of this research. 
From this qualitative process, an initial battery 
of survey statements was generated and distrib¬ 
uted to 17 business school students as a pretest. 
Based on the results of that pretest, the initial 
list of statements was modified in order to mini¬ 
mize redundancy, ambiguity, and leading state¬ 
ments. These modifications resulted in a final list 
of 37 statements. This list was formatted into a 
questionnaire of five-point (strongly disagree to 
strongly agree) Tikert scales, each with a “not ap¬ 
plicable” option. 

Exploratory Factor Analyses. 

The initial questionnaire items were grouped 
into categories as a means of hypothesizing pos¬ 
sible factors. These factors included general sat¬ 
isfaction (with the instructor, with the student’s 
own performance, and with technology in gener¬ 
al), general technological proficiency, technology 
preferences, general ability to learn, and interac¬ 
tion with students and professors. 

Data were collected from undergraduate business 
school students at a Midwestern university who 
participated voluntarily (n = 568). One hundred 
and thirty seven responses were dropped dur¬ 
ing the factor analysis. In addition to the survey 
scale items, additional demographic information 
about each student was also collected, including 
race, age, gender, foreign/non-foreign student’s 
status, home country, major, and number of on¬ 
line courses previously taken. 

The sample consisted of all freshmen registered 
for the introductory Accounting class, all sopho¬ 
mores registered for Statistics I course, all juniors 
registered for the Corporate Finance course and 
seniors who were taking the business capstone 
course. All four courses are required for business 
majors. The survey participation rate is close to 


100% due to the fact that it was administered 
during regular class time. 

Our final sample consists of a total of 431 un¬ 
dergraduate students. Overall, 169 students 
(42.9%) had a single major while 144 students 
(36.5%) were double or joint majors. Joint majors 
are students whose total degree hours are taken 
in two emphasis areas rather than one. Unlike 
double majors who earn two separate degrees, 
joint majors earn a single degree in the two areas 
of emphasis. The sample also included 62 non¬ 
business majors (15.7%). Majority of students 
in the study were white/Caucasian (84.2%). In 
addition, there were more male students (214 or 
53.0%) than female students (190 or 47.0%), and 
the sample comprised of thirty-seven (9.2%) in¬ 
ternational students. Our data also suggest that 
more than half of students (252 or 64.5%) have 
not had any online/Web courses in the past. (See 
Table 2.) 

Exploratory factor analysis was used to suggest 
dimensions and construct a scale on the basis of 
the resulting factor loadings (Churchill, 1979). 
An analysis of the screen plots suggested four 
underlying dimensions. Further analysis using 
principal component factor analysis method 
confirmed the existence of the four factors. Items 
that loaded on more than one factor were elimi¬ 
nated as well as those with factor loadings below 
.60. This process reduced the scale to 18 items, 
with each of the four factors represented by four 
or five items, as depicted in Table 3. 

Scale Description 

The four factors represent the different manifes¬ 
tations of how students feel about technology 
and how satisfied they are with it. Our four fac¬ 
tors are supported by the extant literature. Pro¬ 
ficiency characterizes the general knowledge, ex¬ 
perience, and comfort level that individuals have 
regarding personal technology use (Gabrielle, 
2001; Arbaugh, 2000). Assessment is the indi¬ 
vidual’s assessment of the availability, capability, 
and use of technology at their college or univer¬ 
sity, both inside and outside the classroom (Per- 
raton, 1991; Bates, 1984; Bates, 1995; Cybela, 
1996; Arbaugh, 2000). Performance encompass¬ 
es the degree to which individuals feel that tech¬ 
nology use improves their own performance and 
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Table 2 

Descriptive Statistics 

Major 

No. 

% 

Accounting 

19 

4.8% 

Actuarial Science 

18 

4.6% 

Economics 

3 

0.8% 

Finance 

26 

6.6% 

General Business 

28 

7.1% 

Information Systems 

10 

2.5% 

International Business 

13 

3.3% 

Management 

21 

5.3% 

Marketing 

31 

7.9% 

Joint/Double Majors 

144 

36.5% 

Non-Business Majors 

62 

15.7% 

Undeclared 

19 

4.8% 

Total* 

394 

100.0% 

Race 

No. 

% 

African American 

7 

1.8% 

Asian or Pacific Islander 

20 

5.0% 

Hispanic/Latin American 

4 

1.0% 

Indian Sub Continent 

12 

3.0% 

Mexican American 

4 

1.0% 

White/Caucasian 

336 

84.2% 

Other 

16 

4.0% 

Total* 

399 

100.0% 

Gender 

No. 

% 

Male 

214 

53.0% 

Female 

190 

47.0% 

Total* 

404 

100.0% 

Domestic/International 

No. 

% 

Domestic 

365 

90.8% 

International 

37 

9.2% 

Total* 

402 

100.0% 

Web-Courses Taken 

No. 

% 

0 

252 

64.5% 

1 

76 

19.4% 

2 

33 

8.4% 

3 

17 

4.3% 

4 

1 

0.3% 

5 or more 

12 

3.1% 

Total* 

391 

100.0% 

‘Demographic information : 

survey items are 

optional and, consequently, do not add up to 

the total sample size of 431 due to a number 

of students opting out of answering several 

| items. 


_ 


learning in relation to courses (Arbaugh, 2000). 
Web-course deals with individual preferences 
for a Web-course versus a traditional classroom 
course (Beqiri, Chase, and Bishka, 2010). 

Phase 2: Scale Confirmation 

After establishing the four factors of technology 
satisfaction through factor analysis, the scales 
were distributed to more student respondents 
(n = 253) with the objective of confirming the 
factor structure. Through confirmatory fac¬ 
tory analysis, the four-factor model identified 
in phase 1 was compared to a zero-factor or null 
model as well as to a single-factor model compris¬ 
ing all 18 items. The results (see Table 4) show 
that the four-factor model fits significantly bet¬ 
ter than the other two, as indicated by the im¬ 
provement in the chi-square measure as well as 
other goodness of fit statistics (Joreskog, 1993). 
In the four-factor model, the inter-factor correla¬ 
tions ranged from .08 to .47. Table 5 provides a 
descriptive statistics for the scale scores for each 
of the four factors. 

SUMMARY AND CONCLUSION 

The research presented in this article makes a 
significant contribution to the literature in that 
it represents a first effort to establish a psycho¬ 
metric scale to assess college students’ level of 
satisfaction with technology as part of their col¬ 
lege experience. This study establishes four fac¬ 
tors that make up technology satisfaction in a 
business school. By use of factor analysis, it was 
revealed that students’ satisfaction with educa¬ 
tional technology is related to four main factors. 
These are proficiency, assessment, performance, 
and Web-course (i.e. whether a student pre¬ 
fers taking Web-courses). The four factors were 
subjected to confirmatory process using a new 
sample of students. Our analysis found that the 
four-factor model was a better fit leading to the 
conclusion that business students’ satisfaction in 
technology is related to Proficiency, Assessment, 
Performance, and whether one prefers Web- 
courses or not (Web-course). 

As mentioned previously, it is assumed that tech¬ 
nology is a natural part of the environment for 
students (Oblinger, 2003). As universities invest 
large sums of money into technology, they should 
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Table 3 

Technology Satisfaction Factor Loadings 

Factor 

Factor Loading 


Assess¬ 

ment 

Perfor¬ 

mance 

Web- 

Course 

Proficiency 

(coefficient alpha = .861) 





I have experience in using technology. 

.786 

.134 

.078 

-.045 

I am comfortable using technology in my classes. 

.836 

.100 

.100 

-.023 

I like using technology. 

.844 

.054 

.159 

.038 

I am motivated to learn new technology. 

.700 

-.025 

.252 

.147 

I expect my personal experience with technology to help 
me accomplish the outcomes required in my classes. 

.673 

.151 

.307 

.036 

Assessment 

(coefficient alpha = .815) 





Overall, I am satisfied with the training I have received at 
[institution] to use technology in the classroom. 

.049 

.682 

.162 

-.109 

Overall, I am satisfied with [institution]’s level of classroom 
technology capabilities. 

-.123 

.768 

.066 

-.103 

Overall, I am satisfied with [institution’s level of 
technology capabilities outside the classroom. 

.025 

.710 

-.102 

.105 

Overall, I am satisfied with the availability of technology 
at [institution] outside the classroom. 

.003 

.721 

-.130 

.125 

Overall, I am satisfied with the training I have received at 
[institution] to use technology outside the classroom. 

.056 

.700 

-.041 

.115 

Performance 
(coefficient alpha = .812) 





The use of technology makes course material easier to 
learn. 

.282 

-.040 

.690 

.247 

When my instructor uses technology, it helps me organize 
my course material. 

.222 

.045 

.786 

.070 

When my instructor uses technology, it helps me organize 
my class notes. 

.091 

.053 

.742 

.048 

When my instructor uses technology, it helps my 
performance in the class. 

.205 

.096 

.749 

.148 

Web-Course 
(coefficient alpha = .735) 





I would rather take a course on the Web than in a 
traditional classroom. 

.142 

-.020 

.188 

.679 

I prefer classes which allow face-to-face interaction with 
my instructor. 

.084 

-.033 

.048 

.740 

I prefer classes which allow face-to-face interaction with 
my classmates. 

.023 

.050 

-.039 

.630 

I have a better understanding of the material when the 
instructor lectures to the class. 

.095 

-.111 

.049 

.626 
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Table 4 

Models and Goodness of Fit Indices for 

Confirmatory Factor Analysis (n = 253) 

Model 

Description 

DF 

Chi- 

square 

Delta 

chi-square 

CFI 

NNFI 

RMSEA 

ECVI 

A 

Null model 

153 

3,015.24 

- 

- 

- 

- 

- 

B 

One-factor model 

135 

1,392.18 

1,623.06 

.56 

.50 

.21 

6.71 

C 

4-factor model 

129 

426.96 

965.22 

.90 

.88 

.10 

2.15 


consider to what extent their efforts are incorpo¬ 
rated into a seamless experience for students. In 


other words, does technology enhance students’ 
experience and even facilitate their learning 
process? For these reasons, it is imperative that 
the construct of technology with satisfaction be 
studied with respect to variables that are relevant 
to student experience and learning; variables like 
grades and learning outcomes. If the objective of 
spending resources on technology is to improve 
learning, this scale now provides a means to mea¬ 
sure the extent to which that relationship is true. 

These relationships can be considered in relation 
to student learning styles to determine if certain 
types of students have benefited more from the 
use of technology in education. Other consider¬ 
ations in the future study of the impact of tech¬ 
nology satisfaction are the impact of the accessi¬ 
bility and availability of technology for students. 
Future research should also focus on how the 
four factors of the technology satisfaction scale 


are differentially related to actual student expe¬ 
rience. Additional research should investigate 
which of four factors is more critical than 
the others. 

Technology satisfaction should also be 
studied in the context of diverse popula¬ 
tions. Universities adopt most techno¬ 
logical products as universal efforts for all 
students. The extent to which satisfaction 
with technology differs with respect to 
gender, ethnicity, age, and socio-econom¬ 
ic status should be studied to establish 
whether or not this is the case. Addition¬ 
ally, differences by major should also be 
investigated. 

In short, we feel that the concept of satis¬ 
faction with technology is not only impor¬ 
tant, but is in its infancy. As such, we call 
for researchers to answer the call to address the 
unanswered questions with respect to this con¬ 
struct. 
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